Heuristic Sentence Boundary Detection and Classification

This paper explores the new methodology of detecting boundaries of the sentence by heuristic method and also classifies it. Automatic true detection of the sentence aids in semantically annotating the web. Sentences formed with URL, ellipsis and abbreviations are focus of the study. High performance features are selected for Classification using C4.5 decision trees and K-Means for clustering with the help of datasets. Sentences Classified by human annotators, Manning’s Heuristic algorithm, the proposed Modified Manning’s algorithm, and machine learning supervised and unsupervised algorithms are evaluated. Heuristic learning adapted by this system produces an average F1 score of 96.58% for SBD.